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TITLE OF THE INVENTION 
[0001] Broadcast Receiver Apparatus Producing and Transmitting Electronic Mail Based on 
Data Multiplexed on Broadcast Wave 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0002] The present invention relates to the technique of receiving video and data superposed 
on a broadcast wave and viewing the same. Particularly, the present invention relates to a 
broadcast receiver apparatus producing electronic mail based on data multiplexed on a 
broadcast wave to transmit and receive the electronic mail via the Internet, a remote controller 
controlling the broadcast receiver apparatus, a mail server providing the user with information 
according to electronic mail from the broadcast receiver apparatus, and a broadcast reception 
system including such a broadcast receiver apparatus, remote controller, and mail server. 

Description of the Background Art 

[0003] The TV (television) set receiving and displaying videos transmitted through broadcast 
waves are widely available. When the broadcast station side wishes to know about the viewer's 
response towards a program, a telephone number or address to answer a prize quiz or 
questionnaire is broadcasted during the program to have viewers respond by telephone or an 
appropriately addressed postcard. At the broadcast station side, the viewer's opinion and the 
like are aggregated based on the obtained results. 

[0004] The dissemination is known of a receiver with a data broadcast reception function that 
can receive video transmitted through a broadcast wave as well as data multiplexed on the 
video. Data associated with the broadcasting video is multiplexed on that video to be 
broadcasted as data broadcast. In general, the user displays that information, when required, on 
a display screen such as a CRT (Cathode Ray Tube). 

[0005] To view the broadcasting data, the user depresses a button dedicated to the data 
broadcast, whereby the mode is switched to the data broadcast mode. Upon entering the data 
broadcast mode, the data is displayed on the CRT screen with the currently broadcasting video 
interrupted. Alternatively, the area to display the video is reduced to acquire an area to display 
the data on the CRT screen. 

[0006] Japanese Patent Laying-Open No. 9-162818 discloses another technique to obtain 
data. According to the network service disclosed in Japanese Patent Laying-Open No. 
9-162818, signals including URL (Uniform Resource Locators) information of the network 
service associated with the TV broadcast program are multiplexed on the TV video signals to 
be transmitted. A receiver receiving the signal connects to an access point corresponding to the 
URL via the Internet to receive data, whereby a corresponding homepage is displayed on a 



CRT. 



Atty. Docket No. 0033-0736P 



SUBSTITUTE SPECIFICATION 
AppL No. 09/898,014 



-2- 

[0007] A viewer who wishes to answer a prize quiz or questionnaire broadcasted during a 
television program must jot down the telephone number or address on air on the TV receiver 
set, and then place a telephone call or write a postcard to the announced telephone number or 
address, respectively. At the broadcast station side, the contents of the telephone and postcards 
from the viewers must be aggregated manually. There was the problem that burden on both the 
viewer side and the broadcast station side was imposed. 

[0008] In the case where the mode is switched to the data broadcast mode to display data on a 
CRT screen using the television broadcast reception function, the relationship between the 
video and data broadcast becomes indefinite. In other words, when there are a plurality of 
associated data in the video, the correspondence between video and data broadcast is 
ambiguous. Since the CRT screen is used for data display when the viewer is to view the data 
broadcast, the video on air could not be watched or watched only on a small area on the CRT 
screen. There was a problem that the correspondence is ambiguous. 

[0009] Even if there is detailed information associated with a program, the broadcast station 
must suppress the information to a low amount favorable to as many people as possible due to 
various reasons such as limitation in the amount of data that can be broadcasted, numerous 
types of data, and the overall preference of the viewers. There was a problem that, when a 
viewer wants to obtain more detailed information of the broadcasted data, that information 
must be fetched by other measures. 

[0010] In the network service disclosed in Japanese Patent Laying-Open No. 9-162818, a 
Web page must be produced, and information from many users based on the access to the Web 
page must be stored in the server. The burden on the server is great. There was also the 
problem that the broadcasting video must be interrupted during the period of time the user is 
browsing the Web page. 

SUMMARY OF THE INVENTION 

[0011] The present invention provides a broadcast receiver apparatus that allows a viewer to 
easily keep track of the correspondence between video and video associated data, a remote 
controller, and a broadcast reception system including such a broadcast receiver apparatus and 
remote controller. 

[0012] The present invention also provides a broadcast receiver apparatus that allows a 
viewer to easily obtain detailed information associated with a program, a remote controller, and 
a broadcast reception system including such a broadcast receiver apparatus and remote 
controller. 

[0013] The present invention further provides a broadcast receiver apparatus that can 
automatically produce electronic mail to answer a prize quiz or questionnaire on air, a remote 
controller, and a broadcast reception system including such a broadcast receiver apparatus and 
remote controller. 
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[0014] According to an aspect of the present invention, a broadcast receiver apparatus 
includes a separation unit separating video from data included in a broadcast wave, and a 
display unit displaying the video separated by the separation unit, and displaying a button on 
the video based on button data included in the separated data. The display unit displays video 
associated data corresponding to a button selected by a user. 

[0015] Since the display unit displays video associated data corresponding to a button 
selected by the user, the user can easily keep track of the correspondence between video and 
video associated data. 

[0016] According to another aspect of the present invention, a broadcast receiver apparatus 
includes a separation unit separating video from data included in a broadcast wave, and a 
display unit displaying video separated by the separation unit, and display a button on the video 
based on button data included in the separated data, a mail production unit referring to button 
data corresponding to the button selected by the user to produce electronic mail, and a mail 
transmission unit transmitting the electronic mail produced by the mail production unit. 
[0017] Since the mail production unit refers to button data corresponding to the button 
selected by the user to produce electronic mail, electronic mail required to request detailed 
information associated with a program can be easily produced. Also, electronic mail to answer 
a prize quiz or questionnaire on air can be produced. 

[0018] According to a further aspect of the present invention, a broadcast receiver apparatus 
includes a separation unit separating video from data included in a broadcast wave, a display 
unit displaying the video separated by the separation unit, and a communication unit receiving 
an externally applied command to transmit video associated data included in the data separated 
by the separation unit to an external source. 

[0019] Therefore, video associated data can be displayed on the display unit on an apparatus 
of an external source. 

[0020] According to still another aspect of the present invention, a broadcast receiver 
apparatus includes a separation unit separating video from data included in a broadcast wave, a 
display unit displaying the video separated by the separation unit, a first communication unit 
receiving an externally applied command to transmit button data included in the data separated 
by the separation unit, and receive electronic mail from an external source, and a second 
communication unit transmitting the electronic mail received by the first communication unit. 
[0021] Information required to produce electronic mail can be transmitted to an external 
apparatus, and any received electronic mail can be transmitted through a public circuit. 
[0022] According to a still further aspect of the present invention, a remote controller 
includes a communication unit receiving externally applied data and an image, a display unit 
displaying the image received by the communication unit, and displaying a button on the image 
based on button data included in the data, and a select unit selecting a button displayed by the 
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display unit. The display unit displays video associated data corresponding to a button selected 
by the select unit. 

[0023] Since the display unit displays video associated data corresponding to a selected 
button, the correspondence between video and video associated data can be easily grasped. 
[0024] According to yet a further aspect of the present invention, a remote controller includes 
a communication unit receiving externally applied data and an image, and transmit electronic 
mail to an external source, a display unit displaying the image received by the communication 
unit, and displaying a button on the image based on button data included in the data, a select 
unit selecting a button displayed by the display unit, and a mail production unit referring to 
button data corresponding to the button selected by the select unit and producing electronic 
mail. 

[0025] Since the mail production unit refers to button data corresponding to a selected button 
to produce electronic mail, electronic mail required to request detailed information associated 
with a program can be produced easily. Also, electronic mail to answer a prize quiz or 
questionnaire on air can be produced automatically. 

[0026] According to yet another aspect of the present invention, a broadcast reception system 
includes a broadcast apparatus superposing video and data on a broadcast wave for 
transmission, a broadcast receiver apparatus receiving the broadcast wave transmitted from the 
broadcast apparatus, and a remote controller controlling the broadcast receiver apparatus. The 
broadcast receiver apparatus includes a separation unit separating the video from the data 
included in the broadcast wave transmitted from the broadcast apparatus, a display unit 
displaying the video separated by the separation unit, and displaying a button on the video 
based on button data included in the separated data, and a select unit selecting a button 
displayed by the display unit in response to designation from the remote controller. The 
display unit displays video associated data corresponding to the button selected by the select 
unit. 

[0027] Since the display unit displays video associated data corresponding to the selected 
button, the correspondence between video and video associated data can be easily grasped. 
[0028] According to yet a still further aspect of the present invention, a broadcast reception 
system includes a broadcast apparatus superposing video and data on a broadcast wave for 
transmission, a broadcast receiver apparatus receiving the broadcast wave transmitted from the 
broadcast apparatus, a remote controller controlling the broadcast receiver apparatus, and a 
mail server connected to a public circuit. The broadcast receiver apparatus includes a 
separation unit separating video from data included in the broadcast wave transmitted from the 
broadcast apparatus, a display unit displaying the video separated by the separation unit, and 
displaying a button on the video based on button data included in the separated data, a select 
unit selecting a button displayed by the display unit according to designation from the remote 
controller, a mail production unit referring to button data corresponding to a button selected by 
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the select unit, and producing electronic mail, and a mail transmission unit transmitting the 
electronic mail produced by the mail production unit to the mail server. 

[0029] Since the mail production unit refers to button data corresponding to a selected button 
to produce electronic mail, electronic mail required to request detailed information associated 
with a program can be easily produced. Also, electronic mail to answer a prize quiz or 
questionnaire on air can be produced automatically. 

[0030] According to an additional aspect of the present invention, a broadcast reception 
system includes a broadcast apparatus superposing video and data on a broadcast wave for 
transmission, a broadcast receiver apparatus receiving the broadcast wave transmitted from the 
broadcast apparatus, and a remote controller controlling the broadcast receiver apparatus. The 
broadcast receiver apparatus includes a separation unit separating video from data included in 
the broadcast wave transmitted from the broadcast apparatus, a first display unit displaying the 
video separated by the separation unit, and a first communication unit receiving a command 
from the remote controller to transmit button data included in the data separated by the 
separation unit, video associated data, and an image to the remote controller. The remote 
controller includes a second communication unit receiving button data included in the data 
from the broadcast receiver apparatus, video associated data, and an image, a second display 
unit displaying the image received by the second communication unit, and displaying a button 
on the image based on button data included in the data, and a select unit selecting a button 
displayed by the second display unit. The second display unit displays video associated data 
corresponding to the button selected by the select unit. 

[0031] Since the second display unit displays video associated data corresponding to the 
selected button, the correspondence between video and video associated data can be easily 
grasped. 

[0032] According to still an additional aspect of the present invention, a broadcast reception 
system includes a broadcast apparatus superposing video and data on a broadcast wave for 
transmission, a broadcast receiver apparatus receiving the broadcast wave transmitted from the 
broadcast apparatus, a remote controller controlling the broadcast receiver apparatus, and a 
mail server connected to a public circuit. The broadcast receiver apparatus includes a 
separation unit separating the video from the data included in the broadcast wave transmitted 
from the broadcast apparatus, a first display unit displaying the video separated by the 
separation unit, a first communication unit receiving a command from the remote controller to 
transmit button data included in the data separated by the separation unit and an image to the 
remote controller and receiving electronic mail from the remote controller, and a mail 
transmission unit transmitting the electronic mail received from the remote controller to the 
mail server. The remote controller includes a second communication unit receiving button data 
included in the data from the broadcast receiver apparatus and an image, and transmits 
electronic mail to the broadcast receiver apparatus, a second display unit displaying the image 
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received by the second communication unit, and displaying a button on the image based on 
button data included in the data, a select unit selecting a button displayed by the second display 
unit, and a mail production unit referring to button data corresponding to a button selected by 
the select unit, and producing electronic mail. 

[0033] Since the mail production unit refers to button data corresponding to the selected 
button to produce electronic mail, electronic mail required to request detailed information 
associated with a program can be easily produced. Also, electronic mail to answer a prize quiz 
or questionnaire on air can be produced automatically. 

[0034] The foregoing and other objects, features, aspects and advantages of the present 
invention will become more apparent from the following detailed description of the present 
invention when taken in conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0035] Fig. 1 is a block diagram of a schematic structure of a broadcast reception system 
according to a first embodiment of the present invention; 

[0036] Fig. 2 shows an appearance of a broadcast receiver apparatus 1 02 according to the first 
embodiment; 

[0037] Fig. 3 shows an appearance of a remote controller 103 of the first embodiment; 
[0038] Fig. 4 is a block diagram of a schematic structure of a broadcast receiver apparatus 
102 of the first embodiment; 

[0039] Fig. 5 is a flow chart to describe the procedure of broadcast receiver apparatus 102 of 
the first embodiment; 

[0040] Fig. 6 shows an example of button data; 

[0041] Fig. 7 shows an example of electronic mail produced by a mail production unit 208; 

[0042] Fig. 8 shows another example of button data; 

[0043] Fig. 9 shows a display of a button superposed on video; 

[0044] Fig. 10 shows a display of an available region in video; 

[0045] Fig. 1 1 is a block diagram of a schematic structure of a broadcast receiver apparatus 
102 1 according to a second embodiment of the present invention; 

[0046] Fig. 12 shows an appearance of a remote controller 103 f of the second embodiment; 
and 

[0047] Fig. 13 is a block diagram of a schematic structure of remote controller 103' of the 
second embodiment. 

DETAILED DESCRIPTION OF THE PRESENT INVENTION 
First Embodiment 

[0048] Fig. 1 is a block diagram of a schematic structure of a broadcast reception system 
according to a first embodiment of the present invention. The broadcast reception system 
includes a broadcast apparatus 101 superposing video associated data and a video associated 
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button linked with video associated data (simply called "button" hereinafter) on a video signal 
to broadcast a program, a broadcast receiver apparatus 102 displaying the video, video 
associated data, and the button linked to video associated data broadcasted by the broadcast 
apparatus 101, and transmitting and receiving electronic mail through a public circuit, a remote 
controller 103 controlling the broadcast receiver apparatus 102 and the like, a mail server 104 
transmitting and receiving electronic mail through the public circuit, and a personal computer 
105 controlled by the remote controller 103. 

[0049] The broadcast receiver apparatus 102 receives the video, video associated data, and 
the button linked to video associated data broadcasted by the broadcast apparatus 101, and 
displays the video and the like on a display unit. When the display is provided with a button 
superposed on the video displayed at the display unit of the broadcast receiver apparatus 102, 
the user can operate the remote controller 103 to select a button, whereby video associated data 
corresponding to the selected button, if any, is displayed at the display unit of the broadcast 
receiver apparatus 102, or transmitted to the remote controller 103 to be displayed at a display 
unit on the remote controller 103. 

[0050] When information such as the mail address or a template of electronic mail is added to 
the button displayed on the display unit of the broadcast receiver apparatus 102, the user can 
operate the remote controller 103 to transmit electronic mail from the broadcast receiver 
apparatus 102 to the mail server 104 through a public circuit. When the remote controller 103 
is a composite apparatus with a telephone set that has the function to transmit electronic mail, 
the electronic mail can be transmitted to the mail server 104 directly via the public circuit. 
Electronic mail can be accumulated in the remote controller 103 and then transmitted together 
to the personal computer 105, so that electronic mail can be transmitted to the mail server 104 
through the public circuit. 

[0051] The transmitted electronic mail has the mail address of the personal computer 105 or 
the like written therein as the return address. The mail server 104 refers to that mail address to 
send the requested video associated data to the personal computer 105 and the like as electronic 
mail. The mail server 104 can classify information based on the contents of the electronic mail 
transmitted from users to produce an aggregation list or the like. 

[0052] Fig. 2 shows an appearance of a broadcast receiver apparatus of the present 
embodiment. The broadcast receiver apparatus 102 includes a CRT 202 displaying the 
received video or the like, an infrared receive/emissive unit 205 transmitting/receiving data 
to/from remote controller 103 through infrared radiation, and an LED (Light Emitting Diode) 
210. When the display is provided with a button superimposed on video on the CRT 202, a 
cursor to select the relevant button is also displayed. The LED 210 is turned on or blinks when 
video associated data is received to notify the presence of video associated data to the user. 
Means to notify the user that video associated data is received is not limited to the LED 210. 
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For example, the presence of video associated data may be announced during a program, or a 
button or a cursor to select a button may be automatically displayed. 

[0053] Fig. 3 shows an appearance of the remote controller 103 of the present embodiment. 
The remote controller 103 includes a "display" button 311 designating display of a video 
associated button and cursor when there is video associated data, an "undisplay" button 312 
designating termination of the display of the video associated button and cursor to provide 
display of only the video, a "determination" button 313 displaying on the CRT 202 the contents 
of video associated data, if any, and designating production of electronic mail when there is no 
video associated data, a cursor move button 314 designating the moving direction of the cursor, 
and an infrared receive/emissive unit 315 transmitting/receiving infrared data to/from 
broadcast receiver apparatus 102 and the personal computer 105. The remote controller 103 
has a circuit configuration similar to that of a general remote controller. Therefore, detailed 
description thereof will not be provided. 

[0054] Fig. 4 is a block diagram of a schematic structure of the broadcast receiver apparatus 
102 of the present embodiment. Broadcast receiver apparatus 102 includes a video/data 
separation unit 201 receiving a broadcast wave through an antenna not shown to separate a 
video signal from data, the CRT 202 displaying the received video or the like, a memory 203 
storing data (button data, video associated data) separated by the video/data separation unit 201 , 
a button data retrieval unit 204 retrieving button data stored in the memory 203 according to 
infrared data transmitted from the remote controller 103, an infrared receive/emissive unit 205 
transmitting/receiving data to/from the remote controller 103 through infrared radiation, a 
cursor control unit 206 controlling movement of a cursor displayed on the CRT 202 according 
to the infrared data transmitted from the remote controller 103, a user information managing 
unit 207 managing preregistered user information, a mail production unit 208 referring to user 
information and the like under control of the user information managing unit 207 to produce 
electronic mail, a mail transmission unit 209 transmitting the electronic mail produced by the 
mail production unit 208, and an LED 210. 

[0055] The video/data separation unit 201 detects and demodulates the broadcast wave 
received through the antenna not shown to separate the video signal from a data signal, and 
provides the video signal to the CRT 202. Accordingly, video is displayed on the CRT 202. 
The video/data separation unit 201 reproduces data from the separated data signal and stores 
the reproduced data in the memory 203. Data superimposed on a video signal includes button 
data and video associated data. 

[0056] When the button data is superposed on a video signal, a button is displayed 
superposed on the video displayed on the CRT 202. The user can select any displayed button. 
When a button is not actually displayed on the CRT 202, the LED 210 can be lit as a virtual 
button, whereby the user is notified that video associated data can be output in addition to the 
video. As to means notifying the presence of video associated data to the user, the presence of 
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video associated data can be announced during the program, or a cursor to select a button may 
be displayed by the cursor control unit 206. However, this means is not limited thereto. 
[0057] The infrared receive/emissive unit 205 carries out infrared data communication with 
the remote controller 103 to receive a cursor move command or button select command from 
the remote controller 103. When the infrared receive/emissive unit 205 receives a button select 
command, button data retrieval unit 204 refers to button data stored in the memory 203 to 
retrieve the button located at the cursor position at the time point of button selection. When the 
button corresponding to the cursor position is in the memory 203 and associated data related to 
that button is present, the button data retrieval unit 204 displays the associated data on the CRT 
202. In the case where a mail address or a template to produce electronic mail is added to that 
button, the relevant information is transferred to the mail production unit 208, and an electronic 
mail production command is issued. 

[0058] When the button data retrieval unit 204 issues an electronic mail production command, 
the mail production unit 208 extracts the reply mail address from the user information 
managing unit 207 and extracts a mail template from the memory 203 as the electronic mail 
main body to produce electronic mail. The mail transmission unit 209 transmits the electronic 
mail produced by the mail production unit 208 to the mail address attached to the button 
through a public circuit. It is to be noted that the user can be confirmed about electronic mail 
transmission prior to transmitting the electronic mail since there are cases where the burden of 
accounting or the like is imposed on the user in electronic mail transmission. 
[0059] The CRT 202 is employed as the display device of the broadcast receiver apparatus of 
the present embodiment. However, the display device is not limited thereto. Any device that 
can display a video, button, a cursor, or the like can be employed such as a liquid crystal 
display. 

[0060] Fig. 5 is a flow chart for describing the procedure of the broadcast receiver apparatus 
of the present embodiment. First, the video/data separation unit 201 determines whether data is 
superposed on the broadcast wave (SI). When data is not superposed on the broadcast wave 
(SI: none), control returns to step SI to repeat the process. When data is superposed on the 
broadcast wave (SI : present), the video/data separation unit 201 stores button data and the like 
in the memory 203 (S2). 

[0061] Then, determination is made whether designation from a user is input through the 
infrared receive/emissive unit 205. In the case where the user has depressed the cursor move 
button of remote controller 103 (S3: cursor move button), the infrared receive/emissive unit 
205 issues a cursor move command to the cursor control unit 206 (S4). Upon receiving a 
cursor move command, the cursor control unit 206 moves the cursor in the direction designated 
by the user. 

[0062] When the user operates the remote controller 103 to select a button (S3: select 
operation), the button data retrieval unit 204 determines whether there is correspondence 
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between the cursor position and the button (S5). When there is no correspondence between the 
cursor position and the button (S5: none), control returns to step SI to repeat the subsequent 
process. When there is correspondence between the cursor position and the button (S5: 
present), the button data retrieval unit 204 extracts information related to the corresponding 
button (video associated data) from the memory 203. 

[0063] When there is video associated data in the memory 203 (S7: Yes), the extracted video 
associated data is displayed on the CRT 202 (S8). When there is no video associated data 
corresponding to the button in the memory 203 (S7: No), information of electronic mail 
corresponding to that button is present. Therefore, the mail production unit 208 produces 
electronic mail from the electronic mail template attached to that button (S9). Then, the mail 
transmission unit 209 transmits the produced electronic mail (S10). 

[0064] Reception of an actually broadcasted program by broadcast receiver apparatus 102 of 
the present embodiment will be described hereinafter. 

Program Example 1 

[0065] The case where a TV shopping program is broadcasted as an example of a program to 
be received will be described. 

[0066] In TV shopping, explanation of a product is provided by the broadcasting video. It is 
assumed that information such as a more detailed catalog on the explained contents is prestored 
in mail server 104. 

[0067] Fig. 6 shows an example of button data used in the TV shopping program. This button 
data includes button coordinates which are the coordinates for button display, the button size, a 
button label, an electronic mail transmission address, a button expiration date, an electronic 
mail expiration date, and an electronic mail template. 

[0068] The button coordinates (x, y) and the button size (w, h) are set at the position 
overlaying the product of interest in the video displayed on the CRT 202. The button is 
displayed overlying the video of the product of interest. As the video changes during the 
program, data of the button coordinates and button size are resent, whereby different button 
coordinates and button size are set. If the button expiration date is set, the button can be easily 
eliminated when the button is no longer required in the course of the program. - 
[0069] In the region enclosed by angle brackets < > in the entries in the electronic mail 
template shown in Fig. 6, user information is written when the mail production unit 208 
produces electronic mail. The remaining portions in the template are left and used when the 
mail production unit 208 produces electronic mail. Since this template can be determined at 
the broadcast station side, a format that can be easily processed by the mail server 104 when the 
electronic mail is received is provided. For example, by assigning the first row, second row 
and third row the product number, return address, and user name, respectively, in the template, 
immediate recognition can be made that information related to the product written on the first 
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row in the electronic mail is to be transmitted to the address identified on the second row. In 
the case where a plurality of buttons have a common send address, it is no longer necessary to 
write a send address in each button by superposing a send address on the video in advance and 
transmitting the video with the send address. 

[0070] The user moves the cursor to the product displayed on the CRT 202 and selects a 
button, whereby production of electronic mail by the mail production unit 208 starts. 
[0071] Fig. 7 shows an example of electronic mail produced by the mail production unit 208. 
As the destination address of this electronic mail, the send address attached to the button of Fig. 
6 is written. In producing the main text of the electronic mail, a template with the button data 
of Fig. 6 added is used. As to <return address> in the template, the stored user information is 
referred to by the user information managing unit 207, and the user's mail address is written 
therein. Also, the user's name is written in the entry of <name> in the template. As to the 
remaining portions in the main body, the contents of the template is used. By setting a mail 
expiration date in the button, transmission of the electronic mail produced by the electronic 
mail production unit 208 can be suppressed. 

[0072] The mail server 104 looks into the main body of the received electronic mail, and 
sends electronic mail written with information corresponding to the requested product to the 
user. Not only information such as a catalog of the product, but also information promoting 
purchase such as a discount coupon or reservation information site can be attached. The user 
can browse the sent electronic mail through the personal computer 105. 

Program Example 2 

[0073] Consider the case where a baseball game is broadcasted as another example of a 
program to be received. A quiz such as which of team X and team Y will win can be issued 
during the program of the baseball game, and invite viewers to respond. A present will be 
given away to those who give the right answer by lottery. Fig. 8 shows an example of button 
data superposed on the video to be transmitted during the program of a baseball game. The 
button data includes data of button 1 and button 2. Display is provided so that button 1 is 
overlaid on the video of team X and button 2 is overlaid on the video of team Y. Since the 
contents of respective button data shown in Fig. 8 are similar to those shown in Fig. 6, detailed 
description thereof will not be repeated. 

[0074] Fig. 9 shows an example of a display in which a button is overlaid on the video of a 
baseball game. Button 1 (701) and button 2 (702) are displayed on the video displayed on the 
CRT 202, corresponding to team X and team Y, respectively. In the case where the buttons 1 
and 2 are virtual buttons not displayed, available regions 801 and 802 as shown in Fig. 10 may 
be displayed, assuming that the team of the available region corresponding to the location of 
the cursor is selected. As the video changes in the course of the program, data of the button 
coordinates and button size are resent, whereby different button coordinates and button size are 
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set. It is also possible to eliminate the button upon the closing time of the questionnaire by 
setting a button expiration date. 

[0075] The process when a button is selected is similar to that described for Program 
Example 1 . Specifically, the mail production unit 208 refers to button data corresponding to 
the button selected by the user to produce electronic mail. The mail transmission unit 209 
sends the electronic mail produced by the mail production unit 208 to the mail server 104 
through a public circuit. 

[0076] Upon receiving electronic mail from a user, the mail server 104 removes any unfair 
answers. For example, when there are a plurality of answers from the same one user, only the 
first received answer is rendered valid, and the remaining answers are taken as fraud. Since the 
electronic mail transmitted from a user is processed by the mail server 104, the template of the 
electronic mail superposed on the broadcasted video does not necessarily have to be readable 
by a person as shown in Fig. 6 or 8. In the case where only the electronic mail corresponding to 
the data transmitted during the program is to be left and others removed, the electronic mail 
template can be transmitted in encrypted form and then decrypted at the mail server 104. Thus, 
only the proper electronic mail can be processed. 

[0077] The mail server 104 can accumulate the received electronic mail to determine a 
winner from those who give the right answer at the end of the game through lottery. Since 
information such as the address and name of the user is written in the contents of the electronic 
mail, the broadcast station can send the present to the address of the winner. Since 
announcement of the winner can be effected through the video during the program other than 
through the electronic mail means, it is not always necessary to transmit the electronic mail to 
the winner's personal computer 105. 

[0078] By similarly producing a quiz program, a panel discussion program, or the like 
besides the above-described program examples, selection type questionnaire, polls, and the 
like can be conducted during the broadcasting period of a program. 

[0079] According to the broadcast reception system of the present embodiment, the broadcast 
receiver apparatus 102 provides a display with a button corresponding to video associated data 
on the video. Therefore, the user can readily grasp the correspondence between video and 
video related data. Since the broadcast receiver apparatus 102 extracts a mail address and an 
electronic mail template from the button data superposed on the broadcast wave to produce 
electronic mail automatically for transmission, the user no longer has to place a telephone call 
or write a postcard, or produce electronic mail. At the broadcast station side, the answer to 
questionnaires and quizzes from users can be aggregated by just referring to the electronic mail 
accumulated in the mail server 104. Therefore, the trouble to aggregate can be eliminated. 
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Second Embodiment 

[0080] The broadcast reception system according to a second embodiment of the present 
invention differs from that of the first embodiment shown in Fig. 1 in the structure of the 
broadcast receiver apparatus and the remote controller. Therefore, detailed description of 
likewise structure and function will not be repeated. In the second embodiment, the broadcast 
receiver apparatus and the remote controller are labeled with the reference numbers of 102' and 
103', respectively. 

[0081] Fig. 11 is a block diagram showing a schematic structure of a broadcast receiver 
apparatus 102 ! of the second embodiment. The broadcast receiver apparatus 102' includes a 
video/data separation unit 201 receiving a broadcast wave through an antenna not shown to 
separate a video signal from data, a CRT 202 displaying a received video or the like, a memory 
203 storing data separated by video/data separation unit 201 (button data, video associated 
data), an infrared receive/emissive unit 205 transmitting/receiving data to/from a remote 
controller 103* through infrared radiation, a mail transmission unit 209 transmitting the 
electronic mail received from the remote controller 103', an LED 210, and a still picture 
production unit 211 extracting a still picture from the video and storing the extracted still 
picture in the memory 203. 

[0082] The still picture production unit 211 cuts out an image of one frame from the video 
separated by the video/data separation unit 201, and reduces the size, if necessary, of the cut 
out image. This reduced image is stored in the memory 203 as a still picture. The still picture 
is displayed in the display unit of the remote controller 103' to be used as a background image 
of button display. This still picture production unit 211 can be omitted if the remote controller 
lacks the function to display a still picture. 

[0083] Upon receiving designation of obtaining video associated data from the remote 
controller 103', the infrared receive/emissive unit 205 extracts and sends to the remote 
controller 103* button data stored in the memory 203 and the still picture produced by the still 
picture production unit 21 1. When there is video associated data corresponding to the button 
selected by the user, the infrared receive/emissive unit 205 transmits the video associated data 
to the remote controller 103 1 in response to designation of video associated data, if any, from 
the remote controller 103'. 

[0084] As will be described afterwards, when electronic mail is produced by the remote 
controller 103 ? , the infrared receive/emissive unit 205 receives that electronic mail. Then, the 
mail transmission unit 209 transmits the electronic mail received from the remote controller 
103' to the mail server 104 via a public circuit. 

[0085] Fig. 12 shows an appearance of a remote controller of the present embodiment. The 
remote controller 103' includes an infrared receive/emissive unit 301 that effects infrared 
communication with the broadcast receiver apparatus 102', a tablet-attached liquid crystal 
display (display unit) 303, a "display" button 311 designating display of a video associated 
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button and cursor when video associated data is present, and an "undisplay" button 312 
terminating display of the video associated button and cursor to display only the video. 
[0086] When the user depresses the "display" button 31 1, the mode is switched to the mode 
of displaying a video associated button. At this stage, the infrared receive/emissive unit 301 
designates the broadcast receiver apparatus 102 1 to obtain video associated data, and receives 
button data and a still picture from the broadcast receiver apparatus 102\ The received still 
picture is displayed on the tablet-attached display 303, and a button is displayed on the still 
picture. As the user touches the displayed button, the tablet-attached liquid crystal display 303 
enters the information and selection of the button is effected. 

[0087] When video associated data is present corresponding to the selected button, the 
relevant video associated data is displayed on the tablet-attached liquid crystal display 303. 
When there is no video associated data, information attached to the button data is referred to, 
and electronic mail is produced. The electronic mail is transmitted to the broadcast receiver 
apparatus 102' via the infrared receive/emissive unit 301. When the user depresses the 
"undisplay" button 312, the video associated button display mode is terminated, and no display 
is provided in the display unit 303. 

[0088] Fig. 13 is a block diagram of a schematic structure of the remote controller 103* of the 
present embodiment. The remote controller 103' includes the infrared receive/emissive unit 
301 transmitting/receiving data to/from the broadcast receiver apparatus 102* through infrared 
radiation, a memory 302 storing data (button data, video associated data) received by the 
infrared receive/emissive unit 301, a tablet-attached liquid crystal display (display unit) 303, a 
button select unit 304 selecting a button corresponding to the touched position on the 
tablet-attached liquid crystal display 303, a button data retrieval unit 305 retrieving button data 
corresponding to the button selected by the button select unit 304, a user information managing 
unit 306 managing preregistered user information, a mail production unit 307 referring to user 
information and the like under control of the user information managing unit 306 to produce 
electronic mail, a control input unit 308 detecting depression of the "display" button 311, 
"undisplay" button 312, and the like, and a mail accumulation unit 309 accumulating electronic 
mail produced by the mail production unit 307. 

[0089] Upon detection of depression of the "display" button 3 1 1 by the control input unit 308, 
the infrared receive/emissive unit 301 sends a command to the broadcast receiver apparatus 
102' to obtain video associated data, and receives button data and a still picture corresponding 
to the command from the broadcast receiver apparatus 102*. The received button data and still 
picture are stored in the memory 302. The display unit 303 displays a still picture stored in the 
memory 302, and displays a button corresponding to the video of that still picture. It is possible 
to display only a button with a button label if the display unit 303 lacks the function to display 
a still picture. 
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[0090] In response to selection of a button by a user touching the display unit 303, the button 
data retrieval unit 305 displays video associated data corresponding to the selected button, if 
any, in the display unit 303. If there is no video associated data corresponding to the selected 
button, button data corresponding to that button is extracted to cause the mail production unit 
307 to produce electronic mail. The electronic mail produced by the mail production unit 307 
is transmitted to the broadcast receiver apparatus 102* by the infrared receive/emissive unit 301 . 
The electronic mail produced by the mail production unit 307 can be accumulated in the mail 
accumulation unit 309, and then transmitted together to the broadcast receiver apparatus 102\ 
When the remote controller 103' is a composite apparatus with a telephone set that includes the 
function to transmit electronic mail, the electronic mail can be transmitted to the mail server 
104 directly through a public circuit. 

[0091] In the present embodiment, a still picture is displayed in the display unit 303 of the 
remote controller 103\ Alternatively, a moving picture may be similarly displayed as in the 
case of the broadcast receiver apparatus 102'. It is to be noted that portability is high since the 
user information managing unit 306 is present in the remote controller 103\ More specifically, 
even if the broadcast receiver apparatus is owned by the public and not by an individual, any 
user away from home who has viewed a broadcast through the broadcast receiver apparatus 
and wishes to obtain detailed information can specify the mail address of his/her personal 
computer at home, and then obtain the desired detailed information when back at home. 
[0092] According to the broadcast reception system of the present embodiment, a button 
corresponding to video associated data is overlaid on a still picture in the display unit 303 of the 
remote controller 103*. Therefore, the user can easily grasp the correspondence between video 
and video associated data. Since the remote controller 103' extracts a mail address and an 
electronic mail template from the button data superposed on a broadcast wave to automatically 
produce electronic mail, the user no longer has to place a telephone call or write a postcard, or 
produce electronic mail. At the broadcast station side, answers to questionnaires and quizzes 
from users can be aggregated by just referring to the electronic mail accumulated in the mail 
server 104. Since a button or the like is displayed in the display unit 303 of the remote 
controller 103' and only the video is displayed in the broadcast receiver apparatus 102 ? , the user 
can browse video associated data while viewing the general video. Therefore, usability is 
improved. 

[0093] Although the present invention has been described and illustrated in detail, it is clearly 
understood that the same is by way of illustration and example only and is not to be taken by 
way of limitation, the spirit and scope of the present invention being limited only by the terms 
of the appended claims. 



